On Shannon and “Shannon’s formula”
نویسنده
چکیده
The period between the middle of the nineteenth and the middle of the twentieth century represents a remarkable period in the history of science and technology. During this epoch, several discoveries and inventions removed many practical limitations of what individuals and societies could achieve. Especially in the field of communications, revolutionary developments took place such as high speed railroads, steam ships, aviation and telecommunications.
منابع مشابه
On Shannon's Formula and Hartley's Rule: Beyond the Mathematical Coincidence
In the information theory community, the following “historical” statements are generally well accepted: (1) Hartley did put forth his rule twenty years before Shannon; (2) Shannon’s formula as a fundamental tradeoff between transmission rate, bandwidth, and signal-to-noise ratio came out unexpected in 1948; (3) Hartley’s rule is inexact while Shannon’s formula is characteristic of the additive ...
متن کاملShannon's entropy revisited
I consider the effect of a finite sample size on the entropy of a sample of independent events. I propose formula for entropy which satisfies Shannon’s axioms, and which reduces to Shannon’s entropy when sample size is infinite. I discuss the physical meaning of the difference between two formulas, including some practical implications, such as maximum achievable channel utilization, and minimu...
متن کاملShannon’s Formula and Hartley’s Rule: A Mathematical Coincidence?
Shannon’s formula C = 2 log(1+P/N) is the emblematic expression for the information capacity of a communication channel. Hartley’s name is often associated with it, owing to Hartley’s rule: counting the highest possible number of distinguishable values for a given amplitude A and precision ±D yields a similar expression C0 = log(1+ A/D). In the information theory community, the following “histo...
متن کاملClaude Shannon: biologist. The founder of information theory used biology to formulate the channel capacity.
Claude Shannon founded information theory in the 1940s. The theory has long been known to be closely related to thermodynamics and physics through the similarity of Shannon’s uncertainty measure to the entropy function. Recent work using information theory to understand molecular biology has unearthed a curious fact: Shannon’s channel capacity theorem only applies to living organisms and their ...
متن کاملTribute to Shannon
Claude Shannon died on 24 February 2001 of the after-effects of Alzheimer disease. With him, one of the greatest scientific minds of the century, and even of all times, disappears. His work exercised a deep influence, although often misknown, in the communication techniques hence in the world where we are living, as well as in the thoughts of the XX century. I shall try, after having evoked the...
متن کامل